Papers with medical research
CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarios (2024.emnlp-main)
Copied to clipboard
| Challenge: | Chinese medical large language models (LLMs) are underperforming on this benchmark, especially where medical reasoning and factual consistency are vital. |
| Approach: | They propose a benchmark with 14 expert-guided clinical scenarios to assess the medical ability of large language models across 7 pivot dimensions. |
| Outcome: | The proposed benchmark has been validated in several ways. |
Zero-Shot Entailment Learning for Ontology-Based Biomedical Annotation Without Explicit Mentions (2025.coling-main)
Copied to clipboard
Rumana Ferdous Munne, Noriki Nishida, Shanshan Liu, Narumi Tokunaga, Yuki Yamagata, Kouji Kozaki, Yuji Matsumoto
| Challenge: | Automated biomedical annotation presents significant challenges when entities are not explicitly mentioned in the text. |
| Approach: | They propose an entailment-based zero-shot text classification approach to annotate biomedical text passages using the Homeostasis Imbalance Process (HOIP) ontology. |
| Outcome: | The proposed method performs well when processes are not explicitly mentioned . it is time-consuming and expensive to annotate biomedical texts with a specific ontology . |